On Deterministic Markov Processes: 
Expandability and Related Topics 



^3 



Alexander Schnurr* 
August 7, 2012 



Abstract 

We analyze the class of universal Markov processes on which do not depend 
on random. For this, as well as for several subclasses, we prove criteria whether a 
function / : [0, oo[— can be a path of a process in the respective class. This is 
useful in particular in the construction of (counter-)examples. The semimartingale 
property is characterized in terms of the jumps of a one-dimensional deterministic 
Markov process. We emphasize the differences between the time homogeneous and 
the time inhomogeneous case and we show that a deterministic Markov process is 
in general more complicated than a Hunt process plus 'jump structure'. 
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1 Introduction 

Deterministic processes arise naturally in several parts of the theory of stochastic pro- 
cesses. Examples include the space dependent drift being one part of a Feller process or 
the seasonal component of a time series in continuous time. Furthermore it is known that 
every PII (i.e. a cadlag process with independent increments) can be written as the sum 
of a PII semimartingale and a deterministic process (cf. [12] Theorem II. 5.1). 

When starting our investigation of deterministic universal Markov processes we had the 
following three questions in mind: 

I) Is there a simple example of a Hunt semimartingale which is not an Ito process? 

II) Can we characterize every (one-dim.) deterministic Markov process? 

III) Given a function / : [0, cxd[— )■ W^. Can we directly say whether there exists a deter- 
ministic process of a certain class having this function as a path? 
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In our recent paper [20] we have solved the first question by introducing the Cantor 
process (cf. Example I6.ip . Furthermore we gave an affirmative answer to the second 
question in the special case of Hunt processes. In the present paper we treat the general 
case of deterministic Markov processes. Several results which are true for Hunt processes 
turn out to be wrong in this more general framework. For d = 1 paths do not have to be 
monotone any more or even of finite variation. This leads to new questions like: when is a 
deterministic Markov process a semimartingale? The criterion is simple, while the proof 
is surprisingly difficult. A new technique had to be developed in order to prove it. 

Here and in the following we mean by a deterministic process a stochastic process 
{X,F^)^^^d = {X^)^^^d which does not depend on u, i.e. there exists a function 
f :R'^x [0, oo[^ M'^ such that 

X,» = /(x,t) 

for every u & Q. Since it is always assumed that P^(Xo = x) = 1 we write for the 
simple process (X, P^) and call it a path of the process. Since deterministic processes are 
adapted to every possible filtration, we do not mention it further but we assume that a 
fixed stochastic basis {fl,J^,¥ = {J-'t)t>o,^) is always in the background. In constructing 
examples it is an advantage of deterministic processes that one does not have to care 
about the filtration. 

We are concerned with Markov processes in the sense of Blumenthal and Getoor (cf. [3J) 
which are sometimes called universal Markov processes (cf. [1], [11]) or Markov families. 
This is due to the fact that the examples we have in mind are related to concepts like 
the semigroup of the process, the generator or the martingale problem. With little effort 
most of the results can be transformed to the case of simple Markov processes (with only 
one starting point). The Markov processes X = {Xt)t>o we are treating here are allowed 
to start in every point of the respective state space and furthermore, time homogeneity 
is present, i.e., writing for s,t > 0, x,y,z G and a Borel set B in M.'^ P^^{z,B) : = 
P^X^t e B\Xs = z) we have 

P,.siz, B) := Pl,{z, B) = P!_,,,^,iz, 5), h>0. (1.1) 

For a deterministic Markov process, time homogeneity can be characterized as follows: if 
there exist s, t > and x, y G M'^ such that X^ = X\ we obtain 

= Xf_^^ (1.2) 

for every /i > 0. The class of deterministic Markov processes serves as a rich source of 
counterexamples (cf. [20j and the present paper). Furthermore they can be used as (parts 
of the) mean processes in stochastic volatility models or as interesting mathematical 
objects in their own right. 

Since the definitions and notations for some of the classes of processes we are treating 
are not unified, let us first fix some terminology: a Markov process in the above sense, i.e. 
satisfying (11. ip . is called Hunt process if it is quasi-left continuous (cf. Definition 1.2.25 
of [r2J) with respect to every P^ [x G M'^). For a deterministic process this is equivalent 
to ordinary left continuity of the paths. 
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We say that a process {X,F^)^^^d is a semimartingale, if is one for every x G M'^. 
A Markov semimartingale X is called ltd process (cf. [5] and [1]) if it has characteristics 
{B, C, v) of the form: 



b['\u) = fe^'\Xs{uj)) ds 

Jo 



j = 1, ...,d 

C{\u) = f Q'\XM) ds J, k = l,...,d 

Jo 

fiuj] ds, dy) = N{Xs{u), dy) ds 



where i^^\Q^'' : M'^ — > M are measurable functions, Q{x) = {Q^''{x))i<j^k<d is a positive 
semidefinite matrix for every x G Mf^, and N{x, ■) is a Borel transition kernel on R'^ X 
B{R'^\{0}). 

The following diagram gives an overview on the interdependence of the classes of processes 
we are treating here: 

rich ^ „ Hunt Markov . . , 

„ C ito C • ^- 1 C . ^. , C semimartmgale 

Teller semimartmgale semimartmgale 

n n n 

Feller C Hunt C Markov 

In the present paper we are not too much concerned with Feller processes (only in Section 
2, where we recall the definition). This is because we are interested in processes which 
exhibit jumps. A deterministic jump is a fixed time of discontinuity which Feller processes 
do not have. 

We start with a simple construction principle which we proposed in [20] and which will 
be generalized in Section 3 below: 

Example 1.1. Let i? C M and $ : M — )■ i? be bijective and such that $(0) = 0. In this 
case a Markov process on R is given by 

X^{uj) := ^{t + <^-\x)), for every u; G fi, (1.3) 

i.e. by shifting the function $ to the left and to the right. By inverting the function 
a; I— $(t + $~^(a;)) we know where a path being at time t in z & R has started at time 
zero: x = $($"^(z) - 1). 

The function $ will be called a generating path of the process X since it contains all 
the information of the process on R (cf. Definition 13.31 below). Obviously the restriction 
$(0) = is not needed and any shifted generating path t t— t- $(t — s) (s G M) would have 
served as well. In general one needs infinitely many generating paths in order to describe 
a deterministic Markov process on M'^. 

Let us have a look at a first example which emphasizes how rude a process can be if we 
do not assume any regularity of the paths, though the $ is even bijective on M, i.e. the 
process is given by a single generating path. 
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Example 1.2. Let := {t + + tlqit) and use the construction principle 

described in Example 11.11 we obtain the deterministic Markov process on M 

if X G Q and x + t 
if X G Q and X + i: e Q 
if X ^ Q and X + t ^ Q 
if X ^ Q and X + t G Q. 

For this process every path t i— )■ is discontinuous in every point. The image of every 
path is dense in [x — 1, oo[. 

In the deterministic world homogeneity in space can be written as follows: 

for every t>0 and x,z eW^ we have +^ = + z (1.4) 

The process above is not homogeneous in space since 

X^ + V2 = V2-1^ V2 + 1 = X^^ 

but it is a natural question whether there are Markov processes which are homogeneous 
in space and time, but which are not Levy processes. It turns out that the axiom of 
choice is needed in order to construct such processes. We have not found a proof for the 
following result in the literature, but somehow it belongs to the folklore of our subject. 
The proof it not too difficult and hence left to the reader (compare in this context [TU]). 

Proposition 1.3. Let X be a deterministic Markov process. X is homogeneous in time 
and space, ifft^ X^ is a Q-homomorphism on the Q-vector space M and the other paths 
are given by X^ = X^ + x. 

Deterministic Levy processes form a one-dimensional subspace of the infinite-dimensional 
Q-vector space of deterministic Markov processes which are homogeneous in space and 
time. 

Example 1.4. In order to get a concrete example of a deterministic Markov process which 
is homogeneous in space and time but not a Levy process, let B = {1} U {hi : i E 1} he 
(an uncountable) algebraic Q-basis of M and set $(1) = 1, $(&«) = 26j for every i E I. 
The $ defined as such is bijective since for every y G M written as 

gol + qibi + ... + qrAi 

we obtain 

as its pre-image under $ 

In order to avoid pathological examples as above we will assume in the following that the 
processes we encounter are cddldg. 

Let (X^%g]jd be a deterministic Markov process and let x G M'^. Immediately by f ll.2p we 
obtain: if there exists to < ti such that X^^ = Xf^ then X^^j^f^ = X^^^f^ for every h > 0, 



xt 



t + x + l 

t + X 

t + x 
t + x-1 



+ ^Oi + ••• + 
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i.e. if a path returns to a point, it has visited before, it becomes periodic. In order to 
describe and every path starting in the range R of X^ one could use := Xf. This 
shows that we can be a bit more general by allowing generating paths which do become 
periodic in a certain sense. This is analyzed in detail in Section 3 where we solve our 
initial question III). While in the Hunt case a countable number of generating paths was 
sufficient, we show that in general an uncountable number of generating paths is needed 
in the presence of jumps. The case of 'well behaved' paths leads to a different perspective 
on the classification theorem for Hunt processes (cf. [20] Theorem 2.11). 

Let us give a brief outline on how the paper is organized: in the subsequent section 
we treat the question of expandability, i.e. given a path, does there exist an element 
of a certain class of processes containing this path. Section 3 deals with the general 
structure of such a process while in Section 4 we prove a criterion when a deterministic 
Markov process is a semimartingale. Section 5 is devoted to the more general case of 
time inhomogeneous processes. Some examples complementing those given in the text 
are collected in Section 6. The so called space-time Markov process is included here. Our 
main results are Theorem 12.41 and the closely related Theorems 14.31 and 14.41 

Most of the notation we are using is more or less standard. Vectors are column vectors 
and ' denotes a transposed vector or matrix. The j-th entry of the vector v is v^^\ For a 
set A C M and n G N we write A + n := {r E ^ : r = a + n for an a G A}. Note that we 
prefer to write ]s,t[ for an open interval rather than {s,t) and use the same convention 
for semi-open intervals. In the context of semimartingales we follow mainly [12], in the 
context of Feller processes [I6j and [11^ . 

2 Expandability 

In the construction of counterexamples one is often concerned with only one path rather 
than with a universal process, i.e. one considers a single starting point x and constructs 
a path which meets certain requirements. However, one is still interested if this path can 
really be a part of a process in the desired class. It is important for us to consider universal 
processes, since the definition of e.g. a Feller process does not make sense otherwise. 
In this section we answer the question whether a given right-continuous function / : 
[0, oo[— )■ is a path of a deterministic Markov process or of one of its subclasses. By 
time homogeneity one automatically knows how the process has to behave starting from 
any point within the range of /. Outside of that range one can usually set X^ = x for 
every t > 0. The only exception to this rule are Feller processes (see below). 

Definition 2.1. A right-continuous function / : [0, oo[^ is expandable to an element 
of a certain class of processes C if there exists a deterministic process X G C such that 
xj.^^^ = f{t) for every t > 0. We write C-expandable for short. 

By the same reasoning as in the proof of Theorem 2.7 of [20] we obtain that a path of 
a one- dimensional deterministic Markov process can not move continuously to a point it 
has visited before, i.e. either the function becomes constant at a time ti or it jumps to a 
point it has visited before. The two cases are illustrated below. 
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Therefore, the key is the following kind of periodicity. 

Definition 2.2. Let / : [0, oo[— )■ M*^ be right-continuous. We define 

ti := inf{t > : there exists s <t such that f{s) = fit)} 

and 

to := inf{s > : there exists t > s such that f{s) = f{t)} 

(a) / is called jump-periodic if the following holds: to < ti for every -u > ti we have 
f{u) = f{u-{h-to)). 

(b) / is called finally constant, if there exists a to > such that / is injective on [0,to[ 
and constant on [to, oo[. (Hence to = ti) 

(c) Let / be jump-periodic. The function : /([0,oo[) — )► [0,ti[ given by f^{y) '■= 
inf{t > : /(t) = is called generalized inverse of /. 

Remark 2.3. (a) In the finally constant case one could speak of a period of length zero, 
in the jump-periodic case of length ti — to. If a path never visits a point it has visited 
before we obtain a period of length infinity. 

(b) Not every periodic function is Markov-expandable (e.g. t i— ?• sin(t)). However, for a 
jump-periodic function / the shifted function t /(t — to) is periodic. 

(c) By the right-continuity of the function all infima of the above definition are minima, 
except for inf = oo. 

(d) The notions finally constant and jump-periodic are transfered easily to generating 
paths, i.e. functions on intervals /CM (see Definition 13.31 below). Obviously this makes 
only sense if the right endpoint of / is cxd. 

(e) The notion jump-periodic might be misleading in two or more dimensions, because 
there does not have to be a jump in order to reach a point the process has visited before. 
An example of this kind is given by /(t) := (sin(t), cos(t))'. 

Theorem 2.4. A function f : [0,oo[— > M"' is Markov- expandable iff it is injective or 
finally constant or jump-periodic. 

Proof. Let / be Markov-expandable, i.e. there exists a deterministic Markov process 
such that X^^'^^ = f{t). If this path is not injective, there exists points s < t such 
that f{s) = f{t). Now let to < ti < oo be defined as above. If to = ti the path is 
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locally constant on an interval [to, to + e[ and hence constant on [to,oo[. Otherwise we 
obtain /(to + h) = f {ti + h) for every h > hj time homogeneity. Since every u > ti 
can be written as u = ti + h with h > and since u — {ti — to) = to + h we obtain 
f(u) = fiu-it,-to)). 

Now let one of the three properties be fulfilled. Case 1: to = ti = oo. In this case the 
construction described in 11.11 works, i.e. take / as generating path on /([0,oo[). Outside 
of the range of / we set Xf = x for every t > 0. 

Case 2: to = ti < oo. The function becomes constant at to, i-e. f{t) = c for t > to- In this 
case there is only one point which is visited more than once. The construction works as in 
Case 1, the only difference being that / is inverted only on [0, to[. Paths hitting c become 
constant. In particular we have = c for every t > 0. Time homogeneity is then clear 
and the Markov property is trivially fulfilled since Xf = X\ for x ^ y happens only in 
the case Xf = c = and this case we have X^^^ = c = X^j^y^ for every h > 0. 
Case 3: to < ti < oo. Set 

+ ifxG/([0,oo[) 
]x else. 

Now let z,w G M'^, t,h > and x E /([O, oo[) such that = z. For t < ti we know 
where the path being at time t in z E /([O, oo[) has started at time zero: 

x = f{r{z)-t) 

if t < f^{z). Otherwise (i.e. f^{z) < t < ti) either f^{z) < to and there is no x such 
that = z or to < f^{z) < t <ti and we have x = f{f^{z) — t + ti — to). 
The Markov property is clear, since by definition we have for every t > that x ^ y 
implies Xf ^ Xf . By jump-periodicity we can subtract n ■ {ti — to) for a suitable n E N 
'inside' of / and can therefore assume w.l.o.g. t < ti. We obtain: 

Pt.+hi^, {w}) = i^f[{t+h) + rix)) = w 

^f[{t + h) + r{f{r{z)-t))') =w 
^f(h + r{z))=w 

^Pl^{z,{w}) = l. 

This yields the homogeneity in time. Finally we have x/*^'^'' = f{t) since /^(/(O)) =0. □ 

Virtually all examples of homogeneous diffusions (with jumps) in the sense of in 
the literature are Markov processes. As a first application of the theorem we prove the 
existence of a homogeneous diffusion which is not Markovian. 

Example 2.5. We define the following deterministic process: denote for t G M the saber- 
tooth function {t} := t — [t\ and define 
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We define the process X by 



^l\,|^)-l[4/6,5/6[({^ 



f(t + rix)) ifxG/([0,oo[) 





W-1 



• 1[5/6,1[ 



6 



X 



else. 



For the readers convenience we include the following graphic which shows what the tra- 
jectory of the process looks like: 



This process can be written as 



Xt = x+ / i{Xs)ds 



for every starting point a; G where 



i'^ — is given by 



'(sign(?/W),0)' if = and < i 

(0,-sign(y(2))y if y(2) = and jyWj < 1 

(-sign(?/«),sign(y(2)))' if |^(i) _j/{2)| = i ^nd < 1 

^(0,0)' else. 



[2.1] 



Therefore the process is a homogeneous diffusion, for which i does not depend on the 
starting point, but by Theorem 12.41 it is not a Markov process. 

Remark 2.6. The integral equation (12. ip has infinitely many solutions. Out of these only 
2 solutions are Markovian. Namely the one where the process reaching (0, 0)' always goes 
'up' and the one which always goes 'down' when reaching this point. 

Corollary 2.7. A function f : [0, oo[— )■ M*^ is Hunt- expandable iff it is Markov expandable 
and continuous. 



The order structure of M gives rise to the following characterization in the one- dimensional 
case. Compare in this context [20J Theorem 2.7. 

Corollary 2.8. A function f : [0,oo[— )■ M is Hunt- expandable iff it is continuous and 
there exists a to e [0, oo] such that t ^ f{t) is strictly monotone (increasing or decreasing) 
on [0,to[ o^'i^d constant on [tQ,oo[. 



Since to ^ [0, oo] the 'pure types' of paths which are only constant or strictly monotone 
are included in this corollary. 
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Proposition 2.9. A function f : [0,oo[— t- R'^ is ltd- expandable iff it is Hunt- expandable 
and in addition each component of the vector f — /(O) is absolutely continuous w.r.t. 
Lebesgue measure. 

Proof. For a deterministic Hunt semimartingale tlie second and third characteristic van- 
ish. Therefore the first characteristic can be written as -Bf = Xf — X^ on the image 
of / where Xf is just / shifted to the left. The absolute continuity is inherited from /. 
Anywhere else we set Xf = x for every t > 0, hence Bf = which is as well absolutely 
continuous. The density b we obtain is deterministic and hence optional w.r.t. any filtra- 
tion (Compare in this context [3] Theorem 6.25 and the introduction to Section 7 of that 
article) . □ 

An important subclass of Hunt processes are Feller processes. If the semigroup {Tt)t>Q of 
operators which is defined on the bounded Borel measurable functions by 

Ttu{x) = EMXt)= [ uiXtiu))¥%du) = [ u{y)Pt{x,dy). 

satisfies the following conditions 

(Fl) Tt : Coo(M'^) ^ C^iR"^) for every t > 0, 

(F2) lim^o \\TtU - u\\^ = for every u G Coo(K''). 
we call the process (and the semigroup) Feller. 

The following proposition only holds in the one-dimensional case. 

Proposition 2.10. A function f : [0, oo[— > M is Feller- expandable iff it is Hunt- 
expandable. 

Proof. The 'only if'-part is clear. Now let / be Hunt-expandable. W.l.o.g. let / be in- 
creasing up to time to (cf. Corollary 12. 8p . Set 



fit) if t > 
/(O) +t if t < 



and 



xr--- 



$(t + $'~(,T)) if X G $(] - oo,oo[) 
x else. 



The image of $ is either ] — oo,oo[ or there exists an a G M such that the image is 
] — oo, a[ or ] — oo, a] in the latter cases we set Xf := x for every t > 0. It is simple to 
show that (Fl) and (F2) are fulfilled by this process. Compare in this context Theorem 
3.5 of 1201. □ 



In the general case we have the following: 

Proposition 2.11. // a function f : [0, oo[— ?■ is continuous and finally constant or 
jump-periodic it is Feller- expandable. 
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Proof. The property (F2) is trivially fulfilled. The whole information is contained in 
the restriction /|[0,ti]. Since the image /([0,ti]) is compact, vanishing at infinity is not 
a problem. In fact the only problems which could occur are by destroying continuity. 
However, since /([0,ti]) is closed, those problems could only show up 'within' the curve. 
Now assume that there was a sequence {xn)nm ^ /([0,i^i]) and an h > such that 

Xt„ = Xn > X and {Xt^+h)nm is divergent. 

We have x G /([0,ti]). By compactness we have that there are two points y ^ z and 
subsequences {n{k))ke'M and (^(j))jeN such that 

Since tn{k) and tn{j) are both restricted to the compact interval [0,ti] there exists conver- 
gent sub-subsequences such that 

{tn{k{i))) t and ^ y and X^^,^,,,, ^ x 

iUjii))) ^ and -> y and ^ x 

By continuity of / we obtain X^ = x and Xf+h = y while Xg = x and Xs+h = z. This 
contradicts time homogeneity. □ 

We complement the previous two propositions by an example of a two-dimensional Hunt- 
expandable functions which is not Feller-expandable. 

Example 2.12. The following function / : [0, oo[— )■ is Hunt-expandable but not Feller- 
expandable: 

///I i\ / n\ \ 

{t - 2n) l[2n,2n+l[W 




(4)n+lJ(^-(2^ + l))Jl[Wn+2[ 



For every u G Coo(IR^) which coincides with the projection on the second component on 
[0, 1] X [—1, 1] we obtain 



but 



2n+l) 



1 if n is even, 
-1 else. 



Therefore Ti(m(x„)) = M(Xf") = ^(X^n+i) does not converge. 

The generator (A, D{A)) is the strong right-hand side derivative of the semigroup (Tt)t>o 
at zero. A Feller process is called rich if the domain D[A) of this closed operator contains 
the test functions C~(M'='). In it was shown that every rich Feller process is an Ito 
process. By Proposition 3.8 of ^20] and the above reasoning we obtain the following: 
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Proposition 2.13. A function f : [0,oo[— i- M is rich- Feller- expandable iff it is continu- 
ously differentiahle on ]0,oo[, right- differentiahle at zero and if there exists a to & [0, C)o] 
such that dtfit) on [0,to[ and dtfit) = on ]to, oo[. 

Rich Feller processes are interesting, because by a classical result which is due to Courrege 
[6] one knows that their generator A is a pseudo-differential operator. The symbol of this 
operator contains a lot of information about the corresponding process (cf. |18], |19]). 

Remark 2.14. For a function / : [0, oo[— )• M"' to be Levy-expandable it is necessary and 
sufficient to be of the form t i— )■ /(O) -\- c ■ t with c G M'^. This follows directly from the 
Levy-Ito decomposition (cf. e.g. [15] Theorem 1.42). 

3 The General Structure of a Deterministic Markov 
Process 

Our starting point is the following result for Hunt processes (see [20] Section 2). We will 
see in the following that the generalization for deterministic processes with jumps is not 
straight forward and a new approach is needed. We will work one-dimensional since even 
in the Hunt case there is no possibility to generalize the result to higher dimensions. 

Theorem 3.1. A family of functions t h-> , each mapping [0,oo[ into R, is a deter- 
ministic Hunt process if and only if there exists a decomposition o/R into disjoint ordered 
intervals {Jj)jQZ where Z C {— n, 0, m} with n, m G NU {oo} such that on every 
Interval Jj the functions t Xf (for x G Jj) are either all constant or there exists a 
continuous generating path $j : Ij — )■ Jj for Jj which is surjective and either strictly 
monotonically increasing or strictly monotonically decreasing and such that 

X^ = ^j{t + <^j\x)) for X G Jj and t G [0, oo[n (/^ - $7^(x)) 

and the Ij are intervals containing zero. 

With every interval Jj we associate the type ©, resp. 0, if $ is increasing, decreasing 
resp. the process is constant on the interval. This allows to describe the process from 
an abstract point-of-view as a sequence like ...|0|0|0|0|.... This sequence is called 
the structure of the process. To emphasize that the upper endpoint of the lower interval 
belongs to the lower (resp. higher) interval we write 0]0 (resp. 0[0). The behavior of the 
paths of the deterministic Hunt process is totally described by the decomposition {Jj)j^z 
and the sequence of generating paths. Compare in this context Remark 2.13 of [20]. In 
particular we described there which structures are forbidden and by which conventions 
one gets a unique representation. 

The theorem above can be used to construct deterministic Markov processes with jumps. 
A first idea is to just add a 'jump structure' to a given Hunt process, i.e. a sequence 
(an, hn) with a„ G R, 6„ G R meaning that if 

limXs = an then Xt = hn 

s-\t 
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from the point bn the process moves on as the underlying Hunt process. In addition 
we could allow the process to jump from a„ to resp. b~ depending on whether the 
path was increasing before reaching or decreasing. Let us remark that this does not 
contradict the Markov property, since the process does not actually reach For a (one- 
dimensional) Hunt process there exist only the possibility to reach a point from above or 
from below. Using such a jump structure one can construct several interesting examples 
of Markov processes. 

It would be nice if every deterministic Markov process could be described by the above 
construction. However, this is not the case. The following example shows that we do not 
even necessarily have an interval of monotonicity before a jump: 

Example 3.2. Let 



where 



:i - t)lA(t) + (t - l)lB(t) + 2 ■ + (1 + t)lc(t) + (3 - t)lD(t) + 3 ■ l[2,oo[(t) 



A 



C :-- 



U 

ne{2No) '- 

u 

ne(2No+l) 



2" - 1 2"+^ - 1 



2" 
1 4 



2n+l 



2n+l 



B :-- 



D :-- 



U 

ne(2No+l) 



2" - 1 2"+^ - 1 



U 

ne(2No) 



1 + 



2" 
1 



2n+l 



2n+l ' 



This path looks as follows: 



While the jumps before time 1 can be described by e.g. 'reaching 1/2 from above, jump 
to -1/2' a description of this kind can not be given for the jump at time 1. This example 
shows that a deterministic Markov process is more than a deterministic Hunt process plus 
'jump structure'. The only way to describe this class of processes seems to be directly via 
the generating paths which do admit jumps and might look quite ugly as the example 
above shows. In Section 6 we include two more nasty examples. Example 16.61 shows that 
it is possible that from one starting point one might reach the same point a„ in different 
ways (which are difficult to describe since there is no interval of monotonicity) resulting 
in different 'landing points' b^ {k = 1,2). This shows that even a start-point- dependent 
jump structure is not sufficient. In the case of Example 16.71 we have even infinitely many 
'landing points' b^ {k G N) for one a„. 

Since it is not enough to use the generating paths of a Hunt process plus a jump structure 
we have to generalize the notion of generating paths itself, in order to capture the behavior 
of non-Hunt paths: 
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Definition 3.3. Let X be a deterministic Markov process and / be an interval of the 
form ]a, oo[ respectively [a, oo[ (with a G [— oo, oo[ respectively a g] — oo, oo[). A surjective 
function $:/—)■ J is called a generating path of X on J C M'^, if it is injective or jump- 
periodic or finally constant and fll.3p holds for every x G J and t G [0, cx)[ fl (/ — 

Remark 3.4. Let us emphasize why generating paths are useful: think of a one-dimensional 
deterministic Levy process which is increasing. Using a function f{y) = cy, defined on 
[0,00 [ as in the previous section, we can only describe the process for x G [0,oo[ by 
shifting this function to the left. In order to describe the whole process, we would need a 
sequence of such functions like: /„(?/) = —n + cy (describing the process on [—n, oo[). In 
contrast to this, one generating path $(?/) := cy defined on $ :] — oo,oo[ describes the 
whole process by shifting it to the left and right. 

Even with the examples 13.21 16.61 and 16.71 in mind one could still hope that a countable 
number of generating paths is sufficient in order to describe the whole process. The 
following example shows that this is not the case, even if the process is a semimartingale 
with bounded increasing paths. 

Example 3.5. Let C be the Cantor set. It is well known that 
C = < X G [0, 1] : there exists a representation x = aj ( -j with aj G {0, 2} 

and that every y G [0, 1] can be written as y = XljeN with bj G {0, 1,2}. These 
representations are unique up to 0- respective 2-periods: 



3 '[-S) ^'[-S) ' 

Let C C C be all points in the Cantor set with a unique representation. Obviously C 
is uncountable since C\C is countable. For every x G C infinitely many ajs are and 
infinitely many ajs are 2. C will be the set of our starting points. Now we define for every 
X G C a path such that the paths have no common points: let x G C, (gn)neN ^ Q+ 
be a denumeration of Q!j_ = Qn]0, oo[ and {h^)nen C N be a denumeration of the indices 
j in the representation {-k) such that aj =0. Set 



jieN 

Since the convergence of the series is is uniform, the function t is cadlag and 

by definition the function is strictly increasing (the function jumps upwards in every 
q G Q\). In particular the process is a semimartingale which is bounded since reaches 
only values in [0, 1]. To be precise, t h-)- Xf takes only values y which can be represented 
in the following way: 

1 \ . . \ Cj = 2 a aj 



Cj f - j such that 



Cj G {0, 1} if Qj 
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Since the representation {-k) is unique (up to the excluded case of periods), we obtain 
that the paths are disjoint. In every point z which is not reached by one of the paths we 
set = z for every t > 0. 

The example shows that the structure of a deterministic Markov process might be quite 
complicated. If we want to describe this structure we can not restrict ourselves to a 
countable number of generating paths (which is sufficient in the Hunt case). We can 
reduce ourselves to a subset of the set of all paths such that every point is contained in 
one of them, since time homogeneity is in place. Such a representation is by no means 
unique. 

Remark 3.6. A countable number of generating paths is sufficient, if the process is well 
behaved in the following sense: the image f^{[0, oo[) of every path can be written as the 
union of intervals If such that there exist ti < t2 with 

where ti is a jump time and t2 is a jump time or the time where the path becomes 
constant and there is no jump time between ti and t2- Though this definition of well 
behaved seems to be rather restrictive, it is met by every example in this paper except of 
13.51 (and those of Section 1 which are not cadlag). Since the paths have to be continuous 
between the times ti and t2 defined as above we obtain by time homogeneity that we 
have for X 7^ ?/ and indices i,j 

/f nJj = 0or/f C/Jor/JC/f. 

This allows us to take a system S of disjoint intervals such that every is either contained 
in S or it is a subset of an element of S. This system is countable since every union of 
disjoint intervals of R is. On every such interval we get a generating path as in the proof 
of Theorem 2.11 of |20j. 

4 The Semimartingale Property 

In the present section we characterize the semimartingale property of a one- dimensional 
deterministic Markov process and show that such a result can not hold in dimensions 
n > 2. The following classical result is adapted from [12] Proposition 1.4.28: 

Proposition 4.1. Let X be a deterministic process. X is a semimartingale iff t ^ Xf 
is cadlag and of finite variation on compact intervals for every x G M°'. 

Every one- dimensional deterministic Hunt process is a semimartingale. This is not the 
case for Markov processes with jumps as the following example illustrates, in which we 
use the construction principle of the previous section: 

Example 4.2. Let X be the deterministic Feller process with structure ©| © |0. Let the 
©-domain be {0}, that is X^ = 0, and the generating paths 



<l>® :] - oo,lHO,cx)[ 



given by $® (t) = 1 - t 
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<l>® :] - oo, 1[^] - oo, 0[ given by $®(t) = t - 1. 

define the process on ]0, oo[ respectively on ] — oo, 0[. Fix a starting point, say x = 1, and 
add a jump structure such that the resulting path starting in x jumps so often from y to 
—y {y g] — 1, 1[) on the time interval ]0, 1] that the jumps are not summable. If the only 
accumulation point of jump times is 1, this results in a cadlag Markov process which is 
not a semimartingale, because the path starting in 1 is of infinite variation on [0, 1]. 

The following result characterizes when a deterministic one-dimensional Markov process 
is a semimartingale. 

Theorem 4.3. A one- dimensional deterministic cddldg Markov process X is a semi- 
martingale iff the jumps of every path 1 1— )■ Xf {x G M) are locally absolutely summable. 

This result is wrong for dimensions d>2. Just take the function g : [0, oo[— given by 
g{t) = {f{t),ty where f{t) is a continuous function of infinite variation on compacts. The 
drift in the second variable ensures that the path is injective. Theorem 12.41 shows that 
this function is Markov expandable (setting Xf = x for every t > and every x outside 
the range of g). However, since one path is of infinite variation, the process, though it 
does not have jumps at all, is still no semimartingale. 

In order to prove this theorem we need the following result which belongs to one- 
dimensional analysis. Even in detailed accounts on the interplay between properties of 
real valued functions like [13], we have not found it. Therefore, we provide a proof. 



Theorem 4.4. A function h : [0,T] — t- M, which is cddldg and injective, is of finite 
variation iff' its jumps are absolutely summable. 

While the 'only if '-part of the theorem is well known (injectivity is not even needed for 
this direction) the 'if'-part is more involved. We need the following two lemmas for to 
prove this direction. The proof of the first one is elementary, while the second one can be 
found e.g. in [H] Corollary VIII. 3.1. 

Lemma 4.5. Let a < c and f : [a, c[— > M. be a continuous function such that f{a) = 
f{c—). Furthermore let b G [a, c[ with f{a) ^ f{b). Let g : [a, c[— )■ M. be a cddldg function 
which is pure jump, that is 

9{x) = g{s)-g{s-). 

a<s<x 

IfEa<s<c \^9{s)\ < (1/2) ■ |/(a) - f{b)\ then f + g is not injective. 

Lemma 4.6. Let a < b < c. A function / : [a, c] — ?■ M is of finite variation on [a, c] iff it 
is of finite variation on [a,b] and [b,c\. 



Proof of Theorem 4-4' Let h : [0,T] ^ M. be an injective cadlag function of bounded 
variation. Divide this function into two increasing cadlag functions: h = — such 
that and h~ do not jump at the same time. We obtain 

0<s<T 0<s<T 0<s<T 

|A/i(s)|>0 |Ah+(s)|>0 |Ah-(s)|>0 
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<ih^T)-h^O)) + {h-iT)-h-m- 
< oo. 

Now suppose the theorem was false. Then we could find an injective cadlag function 
h : [0,T] —7- M, with absolutely summable jumps, which is of infinite variation. Divide 
the cadlag function h into its continuous part / and its pure jump part g. g is of finite 
variation, since the jumps of h are absolutely summable on [0, T]. Therefore, / has to 
be of infinite variation on [0,T], because the functions of finite variation form a vector 
space. Hence, there exists a sequence of partitions 7r„ := {0 = < t2 < ... < = T) 
of [0, T] such that 

E — (4-1) 

Since the jumps of h are absolutely summable, there exists a constant Cg > such that 
X]|Ag(s)|>o = Cg < oo and since / is continuous, there exists a constant Cj > 

such that 1/1 is bounded by C/. By (14.11) we obtain that there exists an G N such that 

E \fKi)-f{tf)\>^Cg + Cf. 

This is fixed from now on and we write tj := {j = l,...,k) in order to simplify 
notation. W.l.o.g we assume that /(O) = and / > 0. If these properties are not met, we 
can shift the function (up/down) and analyze the positive and negative part separately. 
Furthermore we assume w.l.o.g that for every j we have /(tj) — fitj^i) ^ and 

/(tj) - /(tj_i) < ^ /(t,+i) - /(t,) > 0, 

that is, there are no 'useless points' in the partition tttv. The idea is now to rearrange / 
(and hence the original function K) in such a way that lemma is applicable, 
step 1: introduce new points into the partition 
We set 



^1 



^3 



tl 

ts (4.2) 
min{t > si : /(t) = fis[)} 
min{tfc eiTN ■■tk> S2} 
min{t > : /(t) = f{s^,)} 



Stop this procedure when reaching the last point T = t^ or the value of s^ is zero. In 
the latter case start the procedure again in Sj_^_i := s'j to built up the next 'hill'. We call 
the function / restricted to the set [s\, s{[U... U [s^-, a hill though it is not the function 
which looks like a hill, but the traverse line through the points {s[, f{s[)), {s[, f{s[)). 
We continue with the next hill until finally reaching 



T 

-'■ new 




, if/(tfc) < /(tfc_i) 

, else. 
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This finishes the first hierarchical leveL We have to introduce Tnew, since otherwise, 
starting from T, hne (14 ■2p is not defined (we do not need the next, but the next but one 
point). 

We left several gaps between the intervals. Now we treat every interval [sp in the 
same way as above, that is. 











= min{tfc+i e tttv : tfc 


> 4i} 




= min{t > : f{t)-- 


= /(^-i)} 




= mm{tk G tttv : tfc > 


42} 




= min{t > s'j^ : f{t)-- 





until we reach Sj_^_i. Of course, it can happen that s^ji = In this case a third hier- 
archical level is not needed on the interval [sJ,Sj-^^]. If there are intervals in the second 
hierarchical level, where we have to introduce new points s^^ and Sj(j + 1)' then we treat 
the interval [s[j-,Sj(j + 1)'] again as above. We continue with this procedure until the 
union of all intervals (of all hierarchical levels) covers [0,T„e^]. Note that the number of 
additional points is finite. It is simple to prove that an upper bound is given by k^, but 
one can prove better estimates. 
step 2: the last hill remains unfinished 

Let s^'j^^ be the maximum of interval-endpoints in the first hierarchical level with the prop- 
erty f{s^M) = 0- If f{Tnew) 7^ wc do uot havc the property /{s^m) = f{Tnew)- In order 
to bring Lemma [4.51 into account, we introduce a new intermediate point: 

fisZ) :=inf{t>4:/(t) = /(T„eJ} 

This gives us two new intervals: one with no intermediate points and the property f{s\j) < 
f{s'^) and the second one, with the property f{s^) = /{s^m)- The last interval 

on each hierarchical level might have to be treated in this way. However, the sum of all 
differences /(s™^) - /(s^^) plus f(T) - f{Tnew) is bounded by Cf. 




— ti t2 ts ti ^5 ^7 tg —T 

S[ si si = S^ si Tnew IcVcl 

s{i Sn T"^ level 
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step 3: rearranging 

Now we shift the (right-open) intervals as well as the functions /, g and h: we write Sj 
for the length of the interval [s^ , [ and set 

fit) on [0,si[ 
f(t - si + 4) on [si, si + S2[ 



(/k-l \ \ fk-l k 

Vj=i / / u=i j=i 

on the right we continue with the intervals of the second hierarchical level, then of the 

third and so on. Finally we plug together the left intervals defined in step 2 and put them 

to the very right. Just the interval [Tnew,T] remains unchanged. This results in a new 

function /. g and h are defined analogously. In particular we still have f + g = h. g is 

still pure jump, but / is not continuous. 

step 4- not all hills can he made injective by adding jumps 

The function / has the following property: it can be written as [p G N) 

where a^^+i) > a^^\ /(a^^)) = 7(a(^+2)-) and 

{Cf does no longer appear, because of the last unfinished hill). We call every part of the 
function f^^"* ■l^^(2j) ^^(2j+2)^ a hill. / only jumps in points a^^-'^ (j = 1, ...,p + l), i.e., between 
the hills. No matter how we divide the jumps g to the intervals [a^'^^\ a^'^^~^'^^[, we always 
get at least one interval where the requirements of Lemma [4.51 are met. On this interval 
the function h = f + g in not injective. Since we have only rearranged h in order to obtain 
h, the original function h in not injective, as well. Hence we obtain a contradiction. The 
function h can not be of infinite variation and the theorem is proved. □ 



(2i+i)^ 



>4C„ 



The proof of our main result is now relatively simple: 



Proof of theorem \4-3\ The if part is clear by the above Theorem. Now let the jumps of 
X be locally absolutely summable. Fix a; G R and T > 0. By Theorem 12.41 we know what 
the paths of a Markov process look like. We exclude the trivial case = x. By Lemma 
14.61 we can and will assume that the path h{t) := X^ is injective on [0,T] for a T > 0. 
If this was not the case it would be sufficient to analyze the path up to time ti < T (cf. 
Remark 12.21) and then separate the interval into 

[0, ti-d], [ti - d, ti], [ti,ti + d], [ti + d,ti + 2d], [ti + nd, T] 

where d := (ti — to)/2. We divide by 2, because h{ti) = h{to). The result follows from 
Theorem 14.41 □ 
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5 The Time Inhomogeneous Case 

For most of our results time homogeneity is a key ingredient and the results (or analogous 
of the results) do not hold for the time inhomogeneous case. However, complementing 
the results of Section 2 we have the following: 

Proposition 5.1. Every function f : [0, expandable to a space homogeneous 

Markov process (which is in general not time homogeneous) . 

Proof. Just set = x + (/(t) - /(O)). □ 

The proposition says in particular, that every function is expandable to a time inhomo- 
geneous Markov process. The requirements on / (cf. Theorem 12.41) are not needed. 

To find a criterion for a time inhomogeneous Markov process to be a semimartingale (cf. 
Section 4), which is better than Proposition 14 . 1 1 is hopeless. Just take $ to be any function 
of unbounded variation plus the standard construction principle. Note that we can not 
use the space-time Markov process (Xt,t) in order to establish an analogous result, since 
our result does only hold in one dimension. This is interesting from a philosophical point- 
of-view: in the literature one sometimes gets the impression that time inhomogeneous 
Markov processes are not of any interest since one can always use the space-time Markov 
process in order to transfer results. Here we can see that this is not the case. Compare in 
this context example 16.81 

Remark 5.2. The difference between the time homogeneous and the time inhomogeneous 
case can be emphasized by having a look at the following situation: two continuous paths 
and with x <y\ai each other for the first time at to- By the Markov property they 
have to 'stick together' afterwards. In the time homogeneous case this is only possible if 
X^ is monotone increasing on [0, to[ and X^ is monotone decreasing on [0, to[- Furthermore 
X^ and x^ are constant on [to, oo[. Every path X^ with {x < z < y) is known and if for 
any w g] — oo, x[U]?/, oo[ there exists a ti > such that X]^^ G [x^y] we know how the 
path behaves on [ti, oo[. In the time inhomogeneous case we do not know anything about 
the behavior of X^ (resp. X^) on Jto, oo[ or about any path X"^ with w g] — oo, x[U]?/, oo[. 
The only thing we can say is that for every continuous path X'^ {x < z < y) we have 
X' = Xy on [to,oo[. 




time homogeneous time inhomogeneous 
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6 Further Examples 



In this final section we have collected several examples which complement the results of 
the previous sections. 

Example 6.1. Let /i : R — i- [0, 1] be the Cantor function (cf. [7] and |H] Section 8.4) and 
define g : [0, 1] ^ [0, 1] by g{y) := {l/2){h{y) + y). For x let := g{x - [x]) + [x] 
with g defined above and x i— )■ [x] denoting the floor function. The stochastic process 
X = {Xt)t>o defined by 

X^ := ^{t + ^-\x)) 

is called Cantor process. In [20] we have seen that this process is Feller, but not rich and 
that it is not an Ito process, but a Hunt semimartingale. 

Example 6.2. Define Xf = xexp(t). The structure of this process is 0| |©, with the 
generating paths 1 1— )• exp(t) respective 1 1— )■ — exp(t) on ]0, oo [ respective ] — oo, 0[. Though 
the generating paths are diverging the process is still Feller. 

Example 6.3. A deterministic Levy process does not admit a killing and the only way 
how a killing can arise in the context of deterministic Hunt processes is by a state-space 
dependent drift which reaches infinity in finite time. If jumps are taken into account, 
we have two new ways of killing a process: first, we could start e.g. with a Levy process 
= X + ct (c 7^ 0) and add a jump structure like 

fa„, bn) = [c- + ^ 2^ c 



j=0 




U 



This results in a deterministic Hunt process which reaches infinity in finite time, if we 
start in 

On ' 2"~'~ 

neNo 

The second way is by adding an 'instant killing', i.e. if the process reaches a certain set, 
it is sent directly to a cemetery state A. 

Deterministic processes which are strictly monotone increasing can be used as a time 
change in order to kill a given arbitrary process. 

Example 6.4. Let X^ = x + {t ■ {—x)) = x ■ {1 — t). All paths are zero at time one, but 
the behavior afterward depends on the starting point x. This is a process which is not 
Markovian, but still a semimartingale and even a homogeneous diffusion in the sense of 
Definition HI. 2. 18 of [12] with respect to every starting point. Unlike Example 12.51 the 
differential characteristic i depends on the starting point here. 

Example 6.5. We show that the sum of two simple time homogeneous Markov processes 
starting in zero does not have to be again a time homogeneous Markov process (no matter 
how the filtrations are chosen): let Xt := t ■ l[o,i[(t) + l[i,oo[(^) and Yt := —t ■ l[o,2[(^) — 2 ■ 
l[2,oo[(^)- Their sum is 

Zt=Xt + Yt={l-t)- l[i,2[(t) - l[2,oo[(t) 



contradicting time homogeneity. 
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Example 6.6. The following path reaches zero (in the sense of left-limits) infinitely often, 
but in two different ways, which can not be described by means of monotonicity. Let 

:= Yl ((^+l)-^)lA+„(t) + (t-(n+l))lB+„(t) + (t-(n+2))U+(„+i)(t) + ((n+2)-t)ls+( 

nG(2No) 

with A and B as in Example 13.21 




Example 6.7. For n G N let 

j=n ^ ^ 

this results in infinitely many paths with limt^i = but Xf" = n. 
Example 6.8. Here we consider the space-time Markov process. For this purpose let X be 
a one-dimensional deterministic Markov process which is not homogeneous in time, i.e. 
there exist Si < ti and $2 < ^2 such that ti — Si = ^2 — -52 and 

XI = xy^ but XI ^ XI 

for starting points x and y. It is a well-known fact that the corresponding space-time 
process [Xt^t)' is homogeneous in time. This is due to the simple fact that the new 
paths do not coincide in si and S2- This does not mean that the structure of the process 
becomes simpler. In the context of universal Markov processes it means that we get a 
whole new dimension of possible starting points. For these new starting points we get 
the paths by using the injective functions := (x G M) as generating paths. 

This results in a process y on M x [0, oo[ and makes things more complicated e.g. in the 
context of generators: assume that the paths of X are continuously differentiable and 
write f^{t) := Xf . The symbol of the generator of Y is 

where a; is a starting point in the original state space for which we have y = X^^. This 
might be the case for different x. However, for these different starting points the right- 
hand side derivatives in ($^)~^(?/) do coincide by the Markov property. Therefore the 
above expression is well defined. If we considered the original process instead, we would 
have a family of generators with the time dependent symbol 

Pt{x,r]) = -ir]d'^f(t). 

which appears more natural to us. This shows that it is sometimes worthwhile to consider 
the original process and that time inhomogeneous Markov processes have some value on 
their own right. 
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